Method for displaying an icon of media data

ABSTRACT

An information processing system for creating a search data for an application-specific data is proposed. An application processing section inputs or edits data on the basis of an application program. An application-specific data storage section stores the application-specific data input or edited by the application processing section. A search data is created by a search data creating section for searching the application-specific data stored in the application-specific data storage section for a specific data. The search data creating section also creates a correspondence between the search data and the application-specific data. A search data storage section stores the search data created by the search data creating section. A correspondence storage section stores the correspondence between the search data and the application-specific data. Further, a data output section connected to and shared by a plurality of data input or editing units including the application processing section and the search data creating section. The search data creating section creates the search data from the application-specific data sent from the application processing section to the data output section.

This is a continuation of application Ser. No. 08/727,164 filed Oct. 7,1996, now U.S. Pat. No. 5,771,380, which is a continuation ofapplication Ser. No. 08/631,438 filed on Apr. 12, 1996, now U.S. Pat.No. 5,586,316 which is a continuation of application Ser. No. 08/271,923filed Jul. 7, 1994, abandoned.

BACKGROUND OF THE INVENTION

The present invention relates to an information processing system suchas workstations or personal computers which prepare, search and store awide variety of media data including texts, graphics, images and video,or more in particular to the processing of browsing data for handling ascaled-down image of documents, etc.

In the conventional information processing systems such as theworkstations and personal computers in which the documents orspreadsheets are prepared, data such as graphs and image data appliedfrom an image scanner are stored in a memory such as a disk in the formof a file. The operator causes a list of file names and icons to bedisplayed on the display screen and designates the file name or the iconof the desired information thereby to access a particular field.

In JP-A-1-276347 entitled “Information Processing System”, apredetermined page to of a file is extracted and the page data thusextracted is scaled down. The page data for a plurality of files thusscaled down are displayed on the display unit simultaneously. The usercan easily search for the desired data by viewing the scaled-down dataof the pages.

Also, the thesis entitled “How to Handle Large-Scale Document Data inHypermedia Authoring Tool” by Kii, et al., pp. 3-345 to 3-348, aCollection of Lectures at the 44th National Convention of theInformation Processing Society of Japan discloses a method in which thescaled-down image of each document page is displayed on the screen orthe contents of each page are displayed successively in the same region.

Displaying the scaled-down images of each page of a document on thescreen or the contents of each page successively in the same region willhereinafter be referred to as the “browsing”.

In the method for displaying a list of file names or icons on the screenand causing the user to select any one of them, however, file names,names of persons that have prepared them, the date of preparation andsymbols representing the program used for preparation are displayed atmost. To access to data contents, therefore, it is necessary to invokethe application program by which the data has been prepared or whichdisplays the data contents.

Further, JP-A-1-276347 and the “Hypermedia Authoring Tool” fail to referto the browsing of the data prepared by the existing applicationprograms. More specifically, the data input or edited by the programoffered by the system can be browsed, while the data prepared by otherprograms cannot. In the latter case, for the program offered by otherthan the system, the browsing is made possible by generating andmanaging the browsing data corresponding to the data prepared by theprogram. To realize this, however, it is necessary to reconstruct theprogram in such a manner as to generate browsing data or to prepare adata conversion program for generating a browsing data from aprogram-specific data for each of the programs. Also, preparation of adata conversion program makes it necessary to know the program-specificdata format.

Further, the above-mentioned prior art fails to refer to the imagequality after scale-down. More specifically, because of a scaled-downimage, the lines are reduced in size or thin out, or the textinformation or graphics information are substantially lost. As a result,although the person who has prepared the data can associate the pagecontents, the user who simply references cannot substantially obtain theinformation on the pages. Also, the data quantity is increased due tothe image information that is handled, and it takes a considerable timebefore data is read out of the file and displayed.

SUMMARY OF THE INVENTION

The present invention has been developed in view of the above-mentionedprior art, and the primary object thereof-is to provide an informationprocessing system, in which the contents of the media data includingdocuments, graphs, spreadsheets and animations prepared by anapplication program, image data input from an image scanner or the like,video data input from the camera, and composite data prepared bycombining such data can be easily referenced without the user invokingan application program for displaying the data contents. Another objectof the invention is to provide an information processing system, inwhich the data used for referencing (browsing data) are preparedindependently of the application program, i.e., without changing theapplication program or knowing the data format specific to theapplication program. Still another object of the invention is to providean information processing system, in which the quality of thescaled-down image used for accessing is improved.

To achieve the above-mentioned objects, according to one aspect of thepresent invention, there is provided an information processing systemcomprising a plurality of application programs, output means such as adisplay and a printer shared by the application programs, means forgenerating browsing data from the data output by the applicationprograms to the display or the printer, means for relating theapplication-specific data to the browsing data, and means for displayingthe browsing data on the display.

According to another aspect of the invention, there is provided aninformation processing system comprising means for scaling down themedia data without being converted to an image data, means forgenerating the image data (hereinafter referred to as “the browsingdata”) configured in such a manner as to permit the grasping of thecontents of the media data, means for relating the browsing data thusgenerated to the media data, means for searching for the browsing datafrom media data identifiers, means for scaling up/down the browsing datathus searched for, and means for displaying the browsing data thusscaled up/down. There are a plurality of means for scaling up/down thebrowsing data, which are changeable according to the characteristics ofthe browsing data.

At the time of data search, a list of browsing data is displayed on thedisplay and the application-specific data corresponding to the browsingdata selected by the user are searched for by using the relating means.

At the time of data registration, on the other hand, the browsing dataare prepared from the data applied to the display or printer at the sametime that the application-specific data are registered, and are managedin relation to the application-specific data.

In the case where the application for preparing media data is differentfrom that for searching for media data, display of the browsing data bythe search application suffices for accessing the contents, and it isnot necessary to invoke the application for media data preparationsimply for accessing the contents.

In the case where the user is caused to select a file storing the mediadata at the time of executing an application, a list of browsing data isdisplayed on the screen for selection by the user instead of causing theuser to input a file name or select from a list of file names or iconsdisplayed. As a result, the user can select a file after knowing thefile contents, thereby facilitating the acquisition of an intended mediadata. Also, in the case where the media data is so large as to cover aplurality of pages, the pages are successively displayed (hereinafterreferred to as “page flipping”) or all the pages are displayedsimultaneously in the form of a list on the screen, with the result thatthe user is able to understand the whole contents of the media data andtherefore decide whether a particular file is the one intended for.

Further, in view of the fact that the browsing data are generated fromthe data output on the printer or the bit-map data displayed on thedisplay screen, the browsing data corresponding to theapplication-specific data can be generated without modifying theapplication program at all. As a consequence, the data generated by theapplication program that has been developed independently of thebrowsing program can be browsed even when the particular data format isunknown.

Also, in addition to the method for scaling down the browsing data bygenerating the browsing data, a scaled-down image can be generated bythe method described below, in which the media data is scaled down withthe same format and the browsing data is prepared from the media datathus scaled down. In the method for producing a scaled-down image byscaling down the browsing data, it may be difficult to grasp the datacontents due to the disappearance of line in the case where the originalbrowsing data are texts or graphics. The method for generating browsingdata from media data, on the other hand, can produce a high-qualityscaled-down image as the information amount is not reduced at the timeof scale-down.

Furthermore, different suitable scale-down means are used for the binaryimages (black-and-white images) including texts and graphics and thefull-color images including natural images. According to the presentinvention, a plurality of scale-down means are provided from which anappropriate means can be selected, thereby achieving a high-qualityscaled-down image.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram showing the block configuration of an embodiment ofthe present invention.

FIGS. 2A and 2B are diagrams showing the configuration of a managementtable and a correspondence table.

FIG. 3 is a flowchart for explaining the processing of browsing data.

FIG. 4 is a diagram showing an example display of the display unit.

FIG. 5 is a flowchart showing the browsing data search.

FIG. 6 is a flowchart showing the details of a list of scale-downbit-map data of the data obtained by search.

FIG. 7 is a correspondence table between the data format and datastructure.

FIGS. 8A and 8B are diagrams showing an example of hardware and softwareconfiguration according to a modification of the embodiment shown inFIG. 1.

FIG. 9 is a flowchart showing the order of browsing processes.

FIG. 10 is a flowchart showing the order of user operations.

FIG. 11 is a block diagram showing the configuration of anotherembodiment.

FIG. 12 is a flowchart showing the order of printer driver operationaccording to the embodiment shown in FIG. 11.

FIGS. 13A and 13B are diagrams showing the hardware and softwareconfigurations of a modification of the embodiment shown in FIG. 11.

FIG. 14 is a flowchart showing the procedure for the scaled-down imagedisplay in a window.

FIG. 15 is a flowchart showing still another embodiment.

FIG. 16 is a diagram showing a configuration example of the datamanagement table according to the embodiment of FIG. 15.

FIG. 17 is a flowchart showing the processes at the browsing datamanagement section.

FIG. 18 is a flowchart for explaining the process for newly preparingthe browsing data.

FIG. 19 is a flowchart showing the page data registration process.

FIG. 20 is a flowchart showing the process of page data retrieval.

FIG. 21 is a flowchart showing the process of page data activation.

FIG. 22 is a list of requests accepted by the browsing data managementsection and the parameters and return values thereof.

FIG. 23 is a flowchart showing the process at the media editing section.

FIG. 24 shows an example desk-top display corresponding to the browsingsection.

FIG. 25 is a diagram showing an example configuration of a modificationaccording to the embodiment shown in FIG. 15.

DETAILED DESCRIPTION

Embodiments of the invention will be described below with reference tothe accompanying drawings.

FIG. 1 shows an example of block diagrams for an information processingsystem according to the present invention. The information processingsystem according to the invention, as shown in FIG. 1, comprises a mouse8 and a keyboard 9 for receiving an input from the user, a display 7 forperforming the display, a system device 10 for performing theprocessings, and disks 4, 5, 6 for storing data. The system device 10includes an application processing section 2 for editing/displayingtexts, graphics, images, video and other media data, a browsingprocessing section 3 for managing the relation betweenapplication-specific data and browsing data, list display andscaled-down display of browsing data and registering the browsing data,and a window processing section 1 for receiving the input from the mouse8 or the keyboard 9 and sending them to the section 2 or 3 anddisplaying the output from the section 2 or 3 on the display 7.

The application processing section 2, the browsing processing section 3and the window processing section 1 are configured for storing andcausing dedicated processors to execute each job of an applicationprogram, a browsing program and a window system program. The browsingprocessing section 3 includes a correspondence table 14 for designatingdata types and the video scale-down algorithm for creating the browsingdata. The disk 4 stores the application-specific data 11 such assentences generated on the word processor, for example, according to theapplication program 2. The disks 5, 6, on the other hand, store themanagement table 12 created by the browsing processing section 3 and thebrowsing data 13. The management data in the management table 12 areinformation for managing the relation between the application-specificdata 11 and the browsing data 13.

FIG. 2A is a data format for the application-specific data 11, themanagement table 12 and the browsing data 13, and FIG. 2B a data formatfor the correspondence table 14. The management table 12 includes datanames 21 of the application-specific data 11 and identifiers 22 for thebrowsing data 13. The browsing data 13, on the other hand, include aplurality of scaled-down bit-map data 1 to n and the numbers thereof.The scaled-down bit-map data 1 to N are created either by scaling downthe bit-map data received from the window system 1 or by reading andconverting the application-specific data. The correspondence table 14includes data types 23 and algorithm identifiers 24. According to thisembodiment, the scaled-down version of the bit-map data retrieved fromthe window system 1 is used as the browsing data 13. The appropriatescale-down algorithm, however, varies with the type of original bit-mapdata. The correspondence table 14 is for attaining correspondencebetween the data type and the appropriate scale-down algorithm.

The browsing program 3 registers the browsing data 13 and displays thebrowsing data 13 or the application-specific data 11 according to theuser operation. FIG. 3 shows the flow of user operation and registrationof the browsing data of the browsing program 3, FIG. 4 an example ofscreen for data display, FIG. 5 the flow of operation for data display,and FIG. 6 the detail of step 513 in FIG. 5.

Next, the flow of processings for browsing data registration for thebrowsing program 3 will be explained with reference to FIGS. 1 to 3. InFIG. 3, numerals 301 to 303 designate a user operation flow, andnumerals 320 to 330 a flow of operation for a browsing program.

The user first performs the conventional input and editing operationusing the application program 2 (step 301), and at the end of editing,applies a browsing data registration command from the mouse 8 or thekeyboard 9 (step 302) thereby to input the data type such as naturalImage, or line drawing, black-and-white or color (step 303). Thebrowsing program 3 sets the scale-down algorithm corresponding to theinput data type (step 320) thereby to set i to 0 (step 321) using thecorrespondence table 14.

The user, upon completion of registration of the browsing data (step304), applies a termination command (step 311). In the case where thebrowsing data registration is not yet complete (step 304), the followingprocesses are executed. First, the data-to be registered (natural imageor line drawing) is displayed on the window (step 305), a scaled-downbit-map data registration command is applied (step 306), a display rangeis designated by the mouse (step 307), and if the designated range meetsthe requirement by reference to the browsing data displayed by thebrowsing program (step 308), an OK command is applied (step 309).Otherwise (step 308), a CANCEL command is applied (step 310) and theprocess returns to step 307. Meanwhile, the browsing program applies acommand (step 322), and repeats the following process while theparticular command remains a scaled-down bit-map data registrationcommand (step 323). First, the range input mode is entered (step 324),the window bit-map data corresponding to the designated range isretrieved from the window system 1 (step 325), the position input modeis cancelled (step 326), the bit-map data thus retrieved is scaled downby the algorithm set at step 320 with the result thereof displayed onthe display (step 327), the command is received, and if the particularcommand is an OK command (step 328), i is incremented by one as the ithscaled-down bit-map data of the browsing data 13 (step 329). Otherwise(step 328), the process returns to step 324. The user, after applyingthe termination command, inputs the data name 21 of theapplication-specific data (step 312) and thus performs the conventionaloperation for registration specific to the application program (step313). The browsing program, after applying a termination command, inputsthe data name 21 of the application-specific data, and together with theidentifier 22 of the browsing data created by the above-mentionedoperation, registers it with the management table 12 (step 330). In theprocess, the range input mode (step 324) is defined as the state inwhich all the inputs from the mouse or keyboard are acceptable, that is,the inputs are not delivered to the application processing section 2.

The flow of operation for data search at the browsing processing section3 will be explained with reference to FIGS. 1, 2 and 4 to 6.

FIG. 4 shows an example of screen for data search. The search screen 41includes a condition input section 411, a command input section 412 andan icon list display section 413 which is a region for displaying aplurality of icons 414. The icon 414 includes a scaled-down imagedisplay section 415 and a data name display section 416. The conditioninput section 411 is a region for inputting search conditions such as“the directory name having a file”, “the file including ‘xx’ in the filename” or “the file prepared on or after a given date”. The command inputsection 412 includes a “list button” for displaying a list of all thescaled-down bit-map data for the browsing data, a “next button”, a“preceding button”, a “leading button”, and a “final button” forchanging the scaled-down bit-map data displayed, and an “OK button” anda “CANCEL button” for applying an OK command and a CANCEL commandrespectively. When an icon 414 is selected by mouse, the related commandis applied thereafter to the particular data.

The browsing processing section 3 is for displaying the scaled-downbit-map data list screen 42 on the display once the list button isselected by the mouse. The screen 42 includes a data name displaysection 421, a scaled-down bit-map data list display section 422, and acommand input section 424. The scaled-down bit-map data list displaysection 422 includes a plurality of scaled-down bit-map data displaysections 423.

When “list” command 412 is selected after one of the icons 414 isselected, the data list display section 422 is obtained as a list.

As shown in FIG. 5, when a search condition is input to the conditioninput section 411 (step 511), the browsing program stored and executedin the browsing processing section 3 searches for the data name 21 ofthe application-specific data 11 matching with the particular searchcondition (step 512), displays the scaled-down bit-map data and the dataname 21 corresponding to all the search result data and the data names21 on the icon 414 (step 513), accepts the input from the user (step514), and if the input is for resetting the condition (step 515),returns to step 511. In the case where the input is not for resettingthe condition but for selecting an icon (step 516), on the other hand,the selected icon is stored (step 517), with the process returning tostep 514. Otherwise, if the input is for selection of the next button(step 518), the next scaled-down bit-map data is displayed on theselected icon (step 519), with the process returning to step 514. Whenthe selection of the preceding button is involved (step 520), thepreceding scaled-down bit-map data is displayed on the selected icon(step 521), with the process returning to step 514. If the input is forselecting the head button (step 522), the head scaled-down bit-map datais displayed on the selected icon (step 523), with the process returningto step 514. Otherwise, if the selection of the final button is involved(step 524), the final scaled-down bit-map data is displayed on theselected icon (step 525), with the process returning to step 514. If theselection is the list button (step 516), a list of all the scaled-downbit-map data of the browsing data corresponding to the icon selected isdisplayed on the display 42 (step 527). If selection of the OK button isinvolved (step 530), the terminating process is performed (step 530);otherwise, when the CANCEL button is selected (step 530), nothing isdone to terminate the process. Also, after the step 527, a command isinput on the scaled-down bit-map data list display screen 42 (step 528).If the selection is the OK button (step 529), the process returns tostep 531; otherwise, the process returns to 514 if the CANCEL button isinvolved (step 529). The terminating process (step 531) is defined as aprocess for delivering the name of the application-specific datacorresponding to the icon selected at the time of selection of the OKbutton to the application processing section 2 utilizing the same dataname.

A detailed processing flow of step 513 will be explained with referenceto FIG. 6. The application-specific data are of three classes accordingto their characteristics. The first is those by which the browsingprogram stored in the browsing processing section 2 can interpret thedata format thereof and the data allows automatic and rapid readoperation and creation of a scaled-down image (such as ASCII characterstrings, JIS character strings, graphic data of a specified format,etc.); the second is those by which a scaled-down image can beautomatically created, although the creation or reading thereof consumesa considerable time (such as image data of a specified type); and thethird class is those of a data format that cannot be interpreted by thebrowsing program. According to this embodiment, display isdifferentiated according to these classes.

Step 513 performs the following operations on all the data providing theresult of search made at step 512.

First, whether the data providing the search result can be scaled downand displayed by being processed real-time (step 611) is decided. If itis possible, a scaled-down image is created (step 616) and displayed ona scaled-down bit-map data display section 415 (step 617) real time. Inthe case where the scaled-down display of data is impossible, on theother hand, whether automatic creation of the browsing data from theapplication-specific data is possible or not is decided (step 612). Ifthis is impossible, nothing is displayed on the scaled-down bit-map datadisplay section. If the automatic creation is possible, on the otherhand, the presence or absence of the corresponding browsing dataidentifier 22 is decided using the management table 12 (step 613). Whensuch an identifier 22 is not available, the browsing data isautomatically created (step 614). Next, the first scaled-down bit-mapdata for the browsing data is displayed on the scaled-down bit-map datadisplay section (step 615), finally followed by displaying the data name(step 617).

The decision at steps 611 and 612 is made in such a way that first thedata format is decided, followed by the decision on one of theabove-mentioned three classes to which the data format decidedcorresponds. Decision on the data format is made according to the dataname of the application-specific data. This decision is made in such amanner as follows: “When a data name ends in ‘.TXT’, a text data isinvolved” or “When the end of a data name is ‘.TIF’, the particular datahas a data format TIFF”. This is, however, conditional on the fact thatthe application program is given the data name according to theabove-mentioned rule. As an alternative, the application-specific datamay be read to make decision according to the features of the data. Forexample, decision is made that ASCII text is involved if all the bytesor the leading several bytes range from 0 to 127 inclusive. Which one ofthe above-mentioned classes to which the data format corresponds isdetermined by defining the table for associating the data format withdata class in advance. The table structure is shown in FIG. 7. In FIG.7, a data format-type correspondence table 71 includes data formats 72and data classes 73. In the data classes 73, “a”, “b”, “c” correspond tothe first, second and third classes described above respectively.

According to this embodiment, the browsing data are created from thebit-map data displayed on the display. Therefore, it is possible tocreate the browsing data corresponding to the applicationprogram-specific data without ever changing the application program. Asa result, the data created by the application program that has beendeveloped totally independent of the browsing program can be browsedeven when the data format thereof is unknown.

Also, in the case where the format of the application-specific data canbe interpreted by the browsing program, the browsing data isautomatically created. The data of which the format can be interpretedcan be browsed without registration by the user. Further, in the casewhere a scaled-down image can be created rapidly from theapplication-specific data, the browsing data is not required to be heldin the disk and therefore the disk consumption is reduced.

In addition, since the scale-down algorithm is determined according tothe class of the bit-map data at the time of registration of thebrowsing data, the display quality (visibility) of the scale-downbit-map data is improved.

When a browsing data is created, the particular data is temporarilydisplayed on the display. Therefore, the user can study whether theparticular data should be registered or the registration range should bereset. More specifically, in the case where the scale-down ratio is sohigh that the contents cannot be identified, the registration range canbe reduced to reduce the scale-down ratio in trials and errors.

According to this embodiment, although the maximum magnitude of thescale-down bit-map data is fixed to 415 in FIG. 4, the magnitude of thebit-map data can be made variable by fixing the maximum value of thescale-down ratio. In this case, extreme scale-down is avoided andtherefore although the range that can be referenced is limited, thecontents can be identified more easily. Also, the proper maximum valueof scale-down ratio varies with the class of the bit-map data (whether anatural image, a line drawing or a text). A scale-down algorithm is thusset corresponding to the data class at 320 in FIG. 3, while at the sametime setting the maximum value of scale-down ratio corresponding to thedata class. In this case, the maximum value of scale-down ratio is heldas an item of 14 in FIG. 1.

Apart from the browsing data derived from the scaled-down bit-map dataaccording to this embodiment, the whole or part of the bit-map databefore scale-down may be used with equal effect. Also, the vector dataor font data obtained by recognizing the bit-map data can be employed asthe browsing data.

FIGS. 8A and 8B show a hardware configuration and a softwareconfiguration respectively of a modification of the embodiment of FIG.1. In this modification, a central processing unit 800 having a mainmemory 801 is connected with a display unit 802 such as a bit-mapdisplay, an input unit such as a mouse or a keyboard and an externalmemory 804. The external memory 804 has stored therein a basic controlprogram 805, a window control program 806, an application program 807, abrowsing program 808, data application-specific 809, browsing data 810,a management table 811 and a correspondence table 812.

These programs and data stored in the external memory 804 areappropriately read into the main memory and executed by the centralprocessing unit 800.

Although a software configuration is shown in FIG. 8B, the processing atthe browsing data display 8081 corresponds to the flow shown in FIG. 5,and that at the browsing data generator/register 8082 to the flow shownin FIG. 3.

Now, another embodiment of the invention will be explained withreference to the drawings.

In the embodiment shown in FIGS. 1 to 8 to attain correspondence betweenthe data name of the application-specific data and the browsing data,the user inputs the data name of the application-specific data at step312 at the time of registering the browsing data. According to theembodiment under consideration, however, a method of attainingcorrespondence without this user operation will be described.

The browsing program 3 according to this embodiment, in addition to thefunctions described in the foregoing embodiment, is assumed to have thefunction of invoking the application program associated with anapplication-specific data when it is designated together with suchoperations as display, editing or printing. This function is realized bythe use of the conventional method as disclosed in “Nikkei Bytes, May1990 pp. 279-283”.

The procedure for this browsing program will be explained with referenceto FIG. 9. First, a command is input (step 911). In the case where thiscommand is for invoking an application program (step 912), the data nameof the application-specific data is stored (step 913), a correspondingapplication program is invoked (step 914), and the process returns tostep 911. If the browsing data registration command is involved (step915), on the other hand, the browsing data is registered (step 916), thedata name stored at step 913 and the browsing data generated areregistered in the management table (step 917), and the process returnsto step 911. For other than the termination command (step 918), theprocessing to meet the command is performed (step 918), while in thecase of the termination command (step 918), the process is terminated.The registration process at step 916 is the same as that of steps 320 to329 in FIG. 3.

According to this embodiment, the user is not required to input the dataname of the application-specific data.

Further, the user operations of steps 302 to 304, 306, and 308 to 311 inFIG. 3 are eliminated. Steps 302, 304, 306 and 311 are eliminated byfixing to one of the scaled-down bit-map data to be registered. The needof steps 308, 309 and 310, on the other hand, is eliminated bycancelling the confirmation by the user of the scaled-down bit-map data.Also, step 303 is not required if automatic decision is made by thebit-map data that has retrieved the type of the bit-map data. Therelevant user operation procedure is shown in FIG. 10. The user firstperforms the conventional editing operation (step 1001), displays thedesired data on the display (step 1005), inputs a registration command(step 1006), designates the range on the screen (step 1007), andregisters the conventional data (step 1013), thereby terminating theprocess.

Now, explanation will be made about the method of automatic decision onthe type of the bit-map data. The bit-map data is assumed to beexpressed as a bit string of data corresponding to each pixel of thescreen, and the bit-map data is assumed to be of four types classifiedaccording to “a black-and-white image or a color image” and “a naturalimage like a landscape photo or a line drawing like a spreadsheet”.

Whether a black-and-white image or a color image involved can be decidedaccording to whether the bit-map data is configured only of a bit stringrepresenting white or black. Also, whether a natural image or a linedrawing is involved can be decided according to whether a predeterminednumber of rectangles of a predetermined size having the same internalbit strings exist over the entire range of the data.

According to this embodiment, even when one screen is configured of aplurality of windows, the bit-map data of the windows can be scaled downby an appropriate scale-down algorithm and then synthesized into asingle scaled-down bit-map data. It is thus possible to maintain thevisibility of the scaled-down bit-map data.

The embodiments shown in FIGS. 1 to 9, in which the bit-map data areretrieved through a window system, may alternatively use a printerdriver in place of the window system. In the embodiment that follows,explanation will be made about a method of generating browsing datausing the printer driver.

FIG. 11 is a block diagram showing an information processing systemaccording to this embodiment, and FIG. 12 a flowchart showing-theoperating procedure of the printer driver.

The information processing system according to this embodiment, as shownin FIG. 11, comprises a mouse 8 and a keyboard 9 for receiving an inputfrom the user, a display 7, a system device 1101 for performing variousprocessing operations, disks 4, 5, 6 for storing data, and a printer1104 for outputting information on the paper. The system device 1101includes an application processing section 2 for editing/displaying themedia data such as texts, graphics, images and video, a browsingprocessing section 1102 for performing management of the relationsbetween the application-specific data and the browsing data, scaled-downdisplay of the browsing data, list display and registration of thebrowsing data, a window system for receiving the input from the mouse 8and the keyboard 9 and sending them to the processing section 2 or 3 anddisplaying the output from the section 2 or 3 on the display 7, and aprinter driver 1103 for outputting information to the printer inaccordance with the instruction from the application, generating thebrowsing data and relating the browsing data to the application-specificdata. The contents of the disks 4, 5, 6 are identical to those shown inthe embodiments of FIGS. 1 to 9.

Next, the operating procedure of the printer driver 1103 will beexplained with reference to FIG. 12. The printer driver, in addition tothe conventional function of receiving the output information from theapplication program and applying it to the printer, has the function ofgenerating the browsing data. First, a destination is decided (step1202), and if the destination is the printer, the conventional outputprocess is performed (step 1202).

In the case where the user designates the output for generating thebrowsing data, on the other hand, the browsing data is generated fromthe output information (step 1203), the data name of theapplication-specific data is input (step 1204), and the identifier ofthe browsing data and the data name of the application-specific data areregistered in the management table (step 1205). The above-mentioneddestination is set by way of the mouse or keyboard by the user inadvance.

In the embodiments shown in FIGS. 1 to 10, the bit-map displayed on thescreen is retrieved and used as browsing data, and therefore only thosedisplayed on the screen can be used as the browsing data. According tothe present embodiment, by contrast, the data to be applied to theprinter are used, so that all the data can be used for browsing. It isthus possible to generate browsing data of a size that otherwise couldnot be contained in the screen.

FIGS. 13A and 13B show the hardware and software configurations of amodification of the embodiment of FIG. 11. In this modification, acentral processing unit 1300 having a main memory 1301 is connected witha display 1302 such as a bit-map display, an input unit 1303 such as amouse or a keyboard, and an external memory 1304. This external memory1304 has stored therein a basic control program 1305, a printer driver1313, an application program 1307, a browsing program 1308, anapplication-specific data 1309, a browsing data 1310, a management table1311 and a correspondence table 1312.

The programs and data stored in the external memory 1304, like those inthe embodiment shown in FIGS. 8A, 8B, are appropriately read into themain memory and executed by the central processing unit 1300.

Although the software configuration is shown in FIG. 13B, the processingin the browsing data display 1381 is represented by the flow shown inFIG. 5, and the processing in the browsing data generator/register 1331by the flow shown in FIG. 3.

Now, explanation will be made with reference to FIG. 14 about a methodof displaying a scaled-down image of the original window in an iconwindow of a window system having the function of converting the windowdisplayed on the screen into an icon window (iconifying) as described in“Introduction to X-Window OSF/Motif Window Manager” by RyoichiKinoshita.

The window system, upon receipt of a request for scaling down a window,generates a copy of the bit-map displayed on the particular window (step1401), scales down the copy to the size of an icon (step 1402), sets thedesignated window in non-display state (step 1403), generates an iconwindow, and displays a scaled-down bit-map data on the icon window (step1404).

When an icon is scaled down, as described with reference to theembodiments of FIGS. 1 to 9, the type of bit-map data may beautomatically decided to use a scale-down algorithm suited to theparticular type. Also, a maximum value of the scale-down ratio can beset to display only a portion of the scaled-down bit-map data in such amanner as not to scale down to more than that value.

FIG. 15 is a block diagram showing an information processing systemaccording to another embodiment of the invention. In FIG. 15, numeral1501 designates a media data editor for inputting/editing the media datasuch as texts, graphics, images and video, numeral 1502 a browsingsection for displaying a list or flipping the pages of the browsingdata, and numeral 1503 a browsing data management section for generatingand managing the browsing data. Numeral 1504 designates a disk forstoring the data file 25 input/edited at the media data editor 1501, andnumeral 1505 a disk for storing the browsing data 22 and the managementdata 21. The media data editor 1501 not only inputs/edits but alsoscales down the media data. The browsing data management section 1503scales down/up, compresses/expands the browsing data and them in a disc.The browsing data management section 1503 includes a work memory 1506.

FIG. 16 shows the structure of the browsing data and the managementtable 1505 in FIG. 15. In FIG. 16, numeral 1621 designates a browsingdata management table, and numeral 1622 browsing data. The browsing datamanagement table 1621 is a list of two-item records including anidentifier 211 for the media data and an identifier 212 for the browsingdata 1622. The browsing data 1622 includes a list of a page number 221,a scale-down algorithm 222, a feature page 223 and page information 224.The page information 224 includes an identifier 2241 for thestandard-sized bit-map file 23, a pointer 2242 (hereinafter referred toas a bit-map-id) to a region of the memory 1506 into which the file inthe browsing data management section 1503 is read, a numerical value2243 indicating the range (digit, line, width, height) read into thememory, a state graph 2244 indicating whether the bit-map data is readinto the memory, an identifier 2245 of the file 24 for storing thescaled-down bit-map file 24, a bit-map-id 2246 for the scaled-downbit-map data, a state flag 2248 for the scaled-down bit-map data, and anumerical value 2249 (number of places, number of lines, width andheight from origin) representing the page features.

In the description that follows, when the bit-map data is loaded in amemory in the browsing data management section 1503, the particularbit-map data is said to be active, and otherwise to be inactive.

FIGS. 17 to 21 show an example of the operation flow of the browsingdata management section shown in FIG. 15, and FIG. 23 an example of theoperation flow of the media data editor.

The browsing data management section 1503 receives a request from themedia editor 1501 and the browsing section 1502 and performs theoperation meeting the request. The request is in the number of 12 asshown in FIG. 22, each having a specific parameter and a return value.In FIG. 22, the media data identifier included in the item of parameteris for designating the media data 1504 in FIG. 15 and is, for example,the file name of the media data file 25.

These requests are applied from the media editor or the browsing sectionto the browsing data management section using the request transmissionfunction or the remote procedure call function like Super ASCII V .3#10133-140.

Next, the operation flow of the browsing data management section 1503will be explained in detail with reference to FIGS. 17 to 21. FIG. 17shows the general flow of operation. FIGS. 18, 19, 20, 21 show theprocess for newly generating the browsing data, registering page data,retrieving the page data and activating the page data respectively.

The browsing data 1503 first waits for a request from the media editor1501 and the browsing section 1502 (step 1701), and decides on the typeof the request when the request arrives. In the case where the requestis for generating the browsing data, the process is performed forgenerating the browsing data anew (step 1703). In the case where therequest is for deleting the browsing data, on the other hand, thebrowsing data management table 1621 is searched for a browsing datacorresponding to the media data of the parameter, which is deletedsimultaneously with the record in the management table (step 1704).Steps 1705 and 1713 that follow, to search for the browsing data, as instep 1702, use the browsing data management table 1621 and theidentifier for the media data designated by the parameter. In the casewhere the request is for page deletion, the data of the page designatedby the browsing data parameter is deleted thereby to reduce the numberof pages by one (step 1705).

When the request is for page addition, on the other hand, the page data224 is generated and by it to the end of the page data list, the numberof pages is increased by one (step 1706). In the case where the requestis for registration of a feature page, the page designated by aparameter is registered in the item 223 of the feature page of thebrowsing data (step 1707). In the case where the request is forretrieval of the feature page, the page in the feature page item 223 ofthe browsing page data 1622 is returned (step 1708). If the request isfor retrieving the number of pages, the number in the page-number item221 of the browsing data 1622 is returned (step 1709). When the requestis for retrieving the feature section, the numeral in the item 22 of thepage feature section designated by the browsing data 1622 is returned(step 1710). In the case where the request is for registration of pagedata, the page data is registered (step 1711), while if the request isfor retrieving the page data, the page data is retrieved (step 1712). Ifthe request is for activating the page data, the page data is activated(step 1713). If the request is for termination, the terminating processis performed. In other words, the browsing data management table 1621and the browsing data 1622 are stored in the disks (step 1714) therebyto terminate the process.

In the process for preparing the browsing data anew, as shown in FIG.18, first, the browsing data management table is searched and decisionis made as to whether there exists any browsing data corresponding tothe media data of the parameter (step 1821). If there is any such data,the existing browsing data is deleted (step 1822); otherwise, the recordof the browsing data management data 1621 is added by one and the mediadata identifier 211 is registered (step 1823). Next, the browsing data1622 is generated, and the identifier 212 thereof is registered againstthe media data identifier 211 (step 1824). The number of pages and thescale-down algorithm designated by a parameter are registered in thepage number item 221 of the browsing data 1622 (1825), therebyterminating the process.

In the page data registration, as shown in FIG. 19, the browsing-data issearched from the media data identifier designated by the parameter(step 1931), and decision is made as to whether the bit-map datacorresponding to the scale-down ratio and the page designated of thebrowsing data is active or not (step 1932). If it is not active, thebit-map data is compressed and stored in the disk (step 1933). If thedata is active, on the other hand, the bit-map-id 2242 or 2246 in thebrowsing data 1622 is changed as designated by the parameter.

In the page data processing section, as shown in FIG. 20, the browsingdata is searched for from the media data identifier designated by theparameter (step 2041), and decision is made as to whether the bit-mapdata corresponding to the scaling ratio and the page designated by theparameter are active or not (step 2042). If the page and the bit-mapdata are not active, the activation process is performed (step 2043).Next, the bit-map-id 2242 or 2246 is returned (step 1934) thereby toterminate the process.

Accordingly, a request is sent from browsing section 1502 to browsingdata management section 1503, and bit map id obtained as a result ofprocessing in browsing data management section 1503 is sent back tobrowsing section 1502. While, a standard size id (2242) is selected inthe event scaling ratio is 1.0, a compressed data bit-map-id (2246) isselected is the event the scaling ratio is other than 1.0, and returnedto browsing section 1502.

In the page data activation process, as shown in FIG. 21, the browsingdata is searched from the media data identifier designated by theparameter (step 2151), and decision is made as to whether the bit-mapdata of a scaling ratio requested is available or not (step 2152). Ifthere is available such data, the bit-map data in the designated rangeis read from the bit-map file of the particular scaling ratio forexpansion thereby to register the range in 2243 (step 2153). Otherwise,the bit-map file of a range designated with a scaling ratio smaller thandesignated for expansion and the range is registered in 2243 (step2154). The algorithm thus registered is scaled down (step 2155). Next,the bit-map-id thus read is registered in the browsing data (step 2156),and that the fact that the particular bit-map data is active isregistered (step 2157) thereby to terminate the process.

Next, the processing operation at the media editor 1501 will beexplained in detail with reference to FIG. 23.

The media editor first edits the media (step 2311) and stores the editedmedia data in the disk (step 2312). In the next step, the request forpreparing the browsing data is sent to the browsing data managementsection (step 2313) and the process representing less than the number ofpages required for browsing is repeated (step 2314). More specifically,a bit-map data of standard size is created (step 2315), the user iscaused to designate the feature portion (step 2316), a page dataregistration request is issued (step 2317), a scaled-down bit-map datais created (step 2318), and a page data registration request forregistration of the particular data is issued (step 2319). Next, theuser is caused to input the feature page (step 2320), and a request forfeature page registration is issued (step 2321) thereby to terminate theprocess.

Now, explanation will be made about the case in which the browsing datais utilized on the desk-top screen of the workstation or the personalcomputer. In the case under consideration, the desk-top processingcorresponds to the browsing section 1502 in FIG. 15. FIG. 24 shows anexample of desk-top screen. In FIG. 24, numeral 61 designates ascaled-down bit-map data displayed as an icon, numeral 62 a manipulationmenu, numeral 63 a scroll bar attached to the icon 61, numeral 64 awindow for scaled-down list display of the page data, and numeral 65 apage number display for indicating the number of pages of the browsingdata by thickness. Icon-manipulating commands are assumed to exist asshown by the menu 62. They include a scale-up command for displaying ascaled-up browsing data, a scale-down command for displaying ascaled-down browsing data, a page-flipping command for displaying thecontents of all pages in succession at the same position automatically,a list display command for creating a new window 64 and displaying thecontents of all the pages on the window 64, and an edit command forediting the corresponding media data. Each icon is associated with acorresponding media data.

To display the browsing data by icons on the screen, the media dataidentifier, the page, the scaling ratio and the range of retrieval aredesignated, and a page data retrieval request is issued to the browsingdata management section 1503 thereby to acquire the bit-map data. Thisbit-map data is displayed on the screen, a page number retrieval requestis issued to acquire the page number, and the page number is displayedin association with the particular number. This process is repeated thenumber of times equal to the number of media data to be displayed.

To scale up or scale down the bit-map data displayed in an icon, a mediadata identifier corresponding to the icon 61 is obtained, a scalingratio suitable for scaling up or scaling down the identifier is set as aparameter, a page data retrieval request is issued, and the bit-map datathus obtained is displayed in place of the bit-map data that has thusfar been displayed. At the time of scale-up, the user is caused todesignate a position in an icon and the bit-map data is displayed aroundthe particular position.

The processes described below are repeated by the number of pages forperforming the page flipping. Specifically, the media data on displayand the bit-map data for the scaling ratio are obtained by issuing apage data retrieval request. This data is displayed, and after waiting apredetermined length of time, a similar processing is performed for thenext page. In the process, the bit-map data is displayed at the sameposition on the screen for all the pages.

To display a list of all the page contents, a window 64 is created, apage data retrieval request equivalent to the number of pages is issued,a scaled-down bit-map data for all the pages is obtained, and they aredisplayed on the window 64 thus created.

The icon 61 has the function of changing the size and scrolling like theprior art window such as the workstation. More specifically, the iconand the bit-map data are compared in size, and in the case where thebit-map data is larger than the icon, a scroll bar 63 is automaticallyattached to the icon and manipulated to make the reference rangechangeable. Also, the size change renders the size of reference rangechangeable.

Further, the bit-map data of the page corresponding to a designatedposition is displayed by designating the page number display by mouse orthe like.

According to this embodiment, the browsing data management section iskept in active state and separated from the other sections all the time.As a consequence, in the case where the browsing data is required by thebrowsing section, the contents can be accessed without invoking theprogram for media data editing or the display program. Also, at leastthe contents can be displayed without the media-editing program if thebrowsing data is available.

Assume that a buffer (or memories 1506, 1507) accessible at high speedis built in the browsing data management section 1503 and the browsingsection 1502. The page data can be displayed immediately without diskaccess by issuing an advance request for activation to the page datahaving a high likelihood of display by the browsing section.

Although the bit-map data is used as browsing data according to thisembodiment, the invention is not limited to it, but a string of printercontrol commands or vector data may alternatively be used with equaleffect. Also, the browsing data is not necessarily of one type but aplurality of types.

Further, apart from the desk-top application of the browsing sectionexplained above, the browsing section can be used as a media data searchsection of a tool for creating a new text or presentation title bycombining various media such as the authoring tool or desk-toppublishing tool. Also, a single browsing data can be used based on aplurality of tools (browsing sections) such as desk-top, authoring tooland desk-top publishing tool.

FIG. 25 shows an example of hardware configuration of the media editor1501, the browsing section 1502 and the browsing data management section1503 in a distributed environment.

In FIG. 25, the LAN is connected with central processing units 100 a, b,c having a main memory built therein. These central processing units 100a, b, c include a display unit 102 and an input unit 103. Also, thecentral processing units 100 a, b, c are connected with externalmemories 104 a, b, c respectively.

The external memory 104 a has stored therein a basic control program105, a window control program 106, a browsing program 108, a browsingdata 110, a management table 111 and a correspondence table 112.

Also, the external memory 104 b has stored therein a basic controlprogram 105, a window control program 106 and a browsing program 108.

Further, the external memory 104 c includes a basic control program 105,a window control program 106, an application program 107 and anapplication-specific data 109 built therein.

In this configuration, each central processing units 100 a, b, c is ableto exchange data mutually through LAN, therefore even in the eventcentral processing unit 100 a is not operated application specific datacan be obtained through central processing unit 100 b by browsing data110.

According to the above-mentioned embodiments, the texts, graphs,spreadsheets, animation or other data created by an arbitraryapplication program for making a display on the display or outputting toa printer, the image data input from the image scanner, the video datainput from the camera, and also the composite data prepared by combiningany of these data can be rapidly browsed without invoking such anapplication program anew. Also, the browsing data can be created withoutaltering the application program.

Further, such data as texts, graphs, spreadsheets or animation createdfrom an application program, the image data input from the imagescanner, the video data input from the camera or the like, and also thecomposite data prepared or the like media data can be accessed readilyand rapidly without invoking the application for the user to display thecontents of the data. Further, the quality of the scaled-down image usedfor access can be improved.

What is claimed is:
 1. A method for displaying an icon of media-data byusing a processing unit, comprising the steps of: a) selecting anediting method according to kind of said media-data; b) generatingimage-data by operating on at least part of the contents of saidmedia-data by using said selected editing method; and c) displaying anicon on the basis of said image-data.
 2. A method for generating an iconof media-data by using a processing unit, comprising the steps of: a)selecting a generating method of said icon according to a data format ofsaid media-data; b) generating image data by operating on at least partof the contents of said media-data, if said media-data has an imageformat; c) generating image data by changing to an image format datafrom a data format for outputting onto an output device an executionresult of an application program corresponding to said media-data, ifsaid media-data has a different format from image format; and d)generating an icon on the basis of said image data generated in saidstep b) or c).
 3. A method for displaying an icon of a window as anexecution result of an application program by using a processing unit,comprising the steps of: a) detecting a designation inputted from aninput device for changing said window displayed at execution of saidapplication program to an icon; b) generating an icon by scaling down atleast one of part of bit-map data corresponding to contents displayed onsaid window; and c) displaying said icon.